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[57] ABSTRACT 

A system that displays text and graphic information with 
vertical blanking interval of a publicly broadcasted video 
signal. The system also includes a personal computer that 
has a VBI decoder which can separate the data from the 
video signal. The separated data contains command and 
address information, which instruct the personal computer to 
retrieve text/graphic information from a storage device, and 
display the retrieved text/graphic information on a computer 
monitor. The personal computer also contains a NTSC 
decoder which can decode the video signal and display a 
television image on the computer monitor. The broadcaster 
inserts data that retrieves text and graphic information which 
correspond to the television image displayed by the com- 
puter monitor. The retrieved text and graphic information 
may be stored for later viewing by the user. 

20 Claims, 3 Drawing Sheets 
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CD ROM INFORMATION REFERENCES FIG. 3 is a schematic showing the layers of a video 

DELIVERED TO A PERSONAL COMPUTER encoder; 

USING THE VERTICAL BLANKING FIG. 4 is a schematic showing the formatting of a video 

INTERVALS ASSOCIATED DATA frame that is inserted into the video blanking interval of a 

TECHNOLOGY FROM A NABTS 5 video signal; 

COMPLIANT TELEVISION BROADCAST FIG, 5 is a schematic showing the formatting of a video 

PROGRAM packet; 

FIG. 6 is a schematic showing the formatting of a message 

BACKGROUND OF THE INVENTION provided to the encoder. 

1. FIELD OF THE INVENTION 10 DETAILED DESCRIPTION OF THE 
The present invention relates to a method and apparatus INVENTION 

for inserting database address information into the vertical Referring to the drawings more particularly by reference 

blanking interval of a video signal that is received by a numbers. FIG, 1 shows a system of the present invention, 

personal computer 15 The system includes a personal computer 10 that receives 

2. DESCRIPTION OF RELATED ART video signals and other information from a broadcaster 12. 
Some computer systems contain NTSC decoders which ^ broadcaster 12 may be any broadcasting system indud- 

allow publicly broadcasted video to be displayed on the to « satellite and cable networks. The broadcaster 12 includes 

monitor of the computer. The video may be displayed in a a vertlcal ™™*m 0™** ins( f * ]* m * has . 

separate window that allows the user to view the video 20 t0 a Vlde * ^oun* 18 "P* 

images while performing other operations on the system. connected to a data source 20. The video source 1* generates 

_ , 4 , . . . . . video signals that have a vertical blanimg intervaL The VBI 

Pffsomd computers can aho be provided wito tt» ori- inserter '* 16 ^ ^ ^ „ 20 ^ ^ 

ented databases that can be retrieved and viewedby the user. vaticjd of ^ ^ s - ^ Thc ^ 

By way of example, there is a program marketed under the . 1* rn , A w „ v T ^,„,, n ° „ f r»»..„« 

TON of San Diego, Calif, which provides an interactive . , ' a/wwrinfln . nfl Jne . . . ta ar „ _ ne miHA/1 K „ a 

, j. ziAiiwAvr j 11 iL a. signal ana accorripanying inserted data are transmitted by a 

encyclopedia. The COMFTON product allows the user to transmitter 22 

select and review text and graphics which correspond to _ ' . , j - j j . . . 

various historical events, geoVaphical locations, e£, ™ c Slgnal . aDd Jf^,^ *Y 

, J , , , , ™ receiver 24. The receiver 24 provides the signal and data to 

It would be desirable to provide a system that would 30 a vcitical b ^ dng interval (VBI) decoder 26. The VBI 

retrieve and display text/graphic data which corresponds to ^codex 26 which separates the data from the video signal, 

a television image displayed on a computer monitor. For xhc ^ provided to a NTSC decoder 28. The 

example, if a user is watching an informational program on converts the video signal into television signals 

elephants, it would be desirable if various facts and graphics ^ ^ ^ displayed on a computer monitor 30. 

on elephants were presented on toe screen along with (he m ^ 1Q icaU contains a central processing 

television image. It would also be desirable if the relevant (C PU)3 A a dynamic random access memory (DRAM) 

acts/graphics were stored in memory for later viewing by ^ 34 amass J c storagcdcvicc such ^ a hard disk drive 

me wc * 36, and an optical disk drive 38. The optical disk drive 38 

SUMMARY OF THE INVENTION 40 contain an optical disk which contains a text and 

graphic based database. By way of example, the optical disk 

The present invention is a system that displays text and may be a "CD-ROM" product sold by COMFTON software 

graphic information with broadcasted television video. The under the trademark INTERACTIVE ENCYCLOPEDIA, 

broadcast system includes a vertical blanking interval (VBI) The COMFTON ENCYCLOPEDIA contains text and 

inserter which inserts data into the vertical blanking interval 4J graphic information which relate to historical events, geo- 

of a broadcasted video signal. The receiving system includes graphical locations, etc, typically found in an encyclopedia, 

a personal computer that contains a VBI decoder which can xh c text and graphic information is located within addres- 

separate the data from the video signal The separated data sa ble memory locations of the optical disk, 

contains command and address information, which instruct jh e CPU 32 receives the data separated from the video 

the personal computer to retrieve text/graphic information w signal by ^ VBI decoder 26. The data typically contains 

from a storage device, and display the retrieved text/graphic command and address information that instruct the CPU 32 

information on a monitor. The personal computer also to retrieve specific text and graphic information from the 

contains a NTSC decoder which can decode the video signal optical ^ 33 aQd display the information on the computer 

and display a television image on the monitor The broad- monitor 30 

caster inserts data that retrieves text and graphic ( information „ nG % ^ a scrccD ^ mc utcr 30. Thc 

which correspond to the television image displayed by the scrcen a ^ow 40 that displays the television 

monitor. The retrieved text and graphic information may be • md a te willdow 43 ^ shows mc tcxt ^ 

stored for later viewing by the user. graphic information retrieved from the optical disk 38. The 

BRIEF DESCRIPTION OF THE DRAWINGS text/graphic information typically relates to the video image 

#> shown in window 40. For example, the video window 40 

The objects and advantages of the present invention will display an elephant The text/graphic window 42 may 

become more readily apparent to those ordinarily skilled in display particular facts regarding elephants. The monitor 30 

the art after reviewing the following detailed description and rnay have a graphical user interface for input commands 44 

accompanying drawings, wherein : allows the user to change television channels. The new 

FIG. 1 is a schematic of the system of the present 55 channel may also contain VBI inserted data which retrieves 

invention; and displays text/graphic information that relates to the 

FIG. 2 is a screen of a video monitor; television images shown on the new channel 
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The personal computer may have a resident program 
which stores the text/graphic information retrieved from the 
optical disk 38 onto the magnetic disk drive 36. 
Additionally, the program may have a configuration window 
which allows the user to select whether the text/graphic 
information is to be saved. The text/graphic information may 
be saved in a file that can be recalled and viewed by the user. 
The video signal may be converted to a binary format for 
storage with the text/graphic information so that the user can 
view the text and video in combination. Alternatively, the 
video signal may be stored on a video cassette recorder (not 
shown). 

As shown in FIG, 3, the format of the inserter 16 may 
have different application layers, including a transport layer 
50, a network layer 52 and a datalink layer 54 which convert 15 
the program data from the data source into a serial data 
stream that can be inserted into the vertical blanking interval 
of the video signal by the VBI inserter 16. The transport 
layer 50 provides an interface with the data source. The data 
source 20 may be a personal computer which is programmed ^ 
to send commands, addresses etc, at predetermined time 
intervals. For example, the video signal may be transmitting 
images of an elephant between 0-5 minutes and a tiger 
between 5-10 minutes. The data source 20 can generate 
command/address data to retrieve "elephant" text/graphic 
data at 0 minutes and then generate command/address data 
to retrieve "tiger* 1 text/graphic data at 5 minutes, and so forth 
and so on. 

The network layer 52 packetizes the data. The datalink 


25 


the optical disk. Alternatively, a common address may be 
employed with a specific optical disk identification (ID). The 
broadcaster may transmit the specific optical disk ID and the 
address data. The computer may have a look-up table which 
allows the CPU to map the requested address information to 
the physical addresses of the requested optical disk. 

In operation, the data source 20 provides program data 
that is inserted into me vertical blanking interval of a video 
signal by the VBI inserter 16. The video signal and data are 
transmitted to the VBI decoder 26 which separates the data 
from the video signal The video signal is converted to a 
television image that is displayed by a computer monitor 30. 
The separated data is provided to the CPU 32 which gen- 
erates commands that retrieve data from the optical disk 38 
in accordance with address information provided with the 
data. The retrieved data is displayed with the television 
image on the monitor 30. The CPU 32 can also command a 
storage of the retrieved data from the optical disk 38 to the 
magnetic disk 36 for later retrieval. 

While certain exemplary embodiments have been 
described and shown in the accompanying drawings, it is to 
be understood that such embodiments are merely illustrative 
of and not restrictive on the broad invention, and that this 
invention not be limited to the specific constructions and 
arrangements shown and described, since various other 
modifications may occur to those ordinarily skilled in the art 

What is claimed is: 

1. A system that receives a video signal and a data signal 
from a broadcaster which inserts the data signal into a 


layer 54 serializes the packeted data for serial transmission 30 yaticd blankmg mtcrval c f the video signal and transmits 


to the VBI inserter 16. In the preferred embodiment, the 
associated data is provided to the VBI inserter in a 
Vtjrame 60 shown in FIG. 4. The Vtjrame 60 includes 
a start frame field STX 62, a data packet field Vt_Packet 64, 
a check field CRC 66 and an end of frame character ETX 68. 35 

In the preferred embodiment, the Vt_Packet 64 is for- 
matted as shown in FIG. 5. The nPacketProtocal field 70 is 
a byte-length field which identifies the packet as one sup- 
ported by the protocol. The nVersion field 72 specifies the 
type of inserter that is transmitting the packet. The nChanID 40 
field 74 is an integer value which provides the channel 
number of the packet in the serialized bitstrcam. The nMes- 
sagelD field 76 specifies the message number of the channel 
on which the packet is transmitted The nPackcOD field 78 
defines the number of packets in a particular message. The 43 
fMorePackets field 80 specifies whether there are any more 
packets in the message. The fReserved field 82 is reserved 
for further use. The length of the data is specified in the 
nDataSize field 84. The nData field 86 contains the data. 


bom the video and data comprising: 

a video receiver that receives the video and data signals; 
a vertical blanking interval decoder that separates the data 

signal from the video signal; 
a video decoder that converts the video signal into a 

television signal; 
a monitor that displays the television signal; 
a non-volatile storage device that contains a text/ 
graphic signal that is resident within said non- 
volatOes storage device; and, 
a central processing unit which receives the data signal 
from said vertical blanking interval decoder and gen- 
erates a command to transfer said text/graphic signal 
from said non-volatile storage device to said monitor to 
display said text/graphic signal on said monitor. 

2. The system as recited in claim 1, wherein said non- 
volatile storage device is an optical disk drive. 

3. The system as recited in claim 1, wherein the data 


In the preferred embodiment, the data is typically pro- 50 signal includes a memory address. 


vided to the inserter 16 by the data source in the format 
shown in FIG. 6. The nMessageProtocal field 88 is a byte 
length field which identifies the type of transmission being 
provided. The nVersion field 90 identifies the version of the 
protocol. The flsHint field 92 indicates that the data is to 55 
precede an event such as a television program. The flsUP- 
date field 94 indicates whether the information is updating 
transmitted information. The fReserved field 96 is unused 
and reserved for later use. The field nDataSize 98 specifies 
the number of bytes in the data field. The nOpcode field 100 60 
define a particular operation to be performed with the data. 
For example, the operation may be a read memory command 
and a display command. The fReserved2 field 102 is not 
used and the bData field 104 contains the data. The data may 
contain the specific addresses to be retrieved from the 65 
storage device 38. The addresses requested typically corre- 
spond to the physical address locations of the desired data on 


4. The system as recited in claim 1, wherein said central 
processing unit commands a storage of said text/graphic 
signal Into a file of said non-volatile storage device. 

5. A system, comprising: 

a broadcaster that transmits a video signal and a data 

signal that is inserted into a vertical blanking interval of 

the video signal; 
a video receiver that receives the video and data signals; 
a vertical blanking interval decoder that separates the data 

signal from the video signal; 
a video decoder that converts the video signal into a 

television signal; 
a monitor that displays the television signal; 
a non-volatile storage device mat contains a text/graphic 

signal that is resident within said non-volatile storage 

device; and, 
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a central processing unit which receives the data signal 
from said vertical blanking interval decoder and gen- 
erates a command to transfer said text/graphic signal 
from said non- volatile storage device to said monitor to 
display said text/graphic signal on said monitor, 5 

6. The system as recited in claim 5, wherein said non- 
volatile storage device is an optical disk drive. 

7. The system as recited in claim 5, wherein the data 
signal includes a memory address. 

8. The system as recited in claim 5, wherein said central 10 
processing unit commands a storage of said text/graphic 
signal into a file of said non-volatile storage device. 

9. A method for displaying video and corresponding text 
on a computer monitor from a transmitted video signal 
which has a data signal inserted into a vertical blanking is 
interval of the video signal, comprising the steps off 

a) receiving the video and data signals; 

b) separating the data signal from the video signal; 

c) converting the video signal into a television signal; ^ 

d) displaying the television signal on a monitor, 

e) generating a command from said separated data signal 
which retrieves a text/graphic signal that is resident on 
a non-volatile storage device; and, 

f) displaying the text/graphic signal on said monitor. 25 

10. The method as recited in claim 9, further comprising 
the step of storing the text/graphic signal in a file. 

11. A method for displaying video and corresponding text 
on a computer monitor* comprising the steps of: 

inserting a data signal into a vertical blanking interval of 50 
a video signal; 

b) transmitting the video and data signals; 

c) receiving the video and data signals; 

d) separating the data signal from the video signal; 35 

d) converting the video signal into a television signal; 

e) displaying the television signal on a monitor; 
generating a command from said separated data signal 

which retrieves a text/graphic signal that is resident on ^ 
a non-volatile storage device; and, 

g) displaying the text/graphic signal on said monitor. 

12. The method as recited in claim 11. further comprising 
the step of storing the text/graphic signals in a file. 

13. A system that receives a video signal and a data signal 45 
from a broadcaster which inserts the data signal into a 
vertical blanking interval of the video signal and transmits 
both the video and data signals, comprising: 

video receiver means for receiving the video and data 
signals; 50 

vertical blanking interval decoder means for separating 
the data signal from the video signal; 


video decoder means for converting the video signal into 

a television signal; 
monitor means for displaying said television signal; 
non-volatile storage means for storing a text/graphic 

signal that is resident within said non-volatile storage 

means; and, 

processing means for receiving the data signal from said 
vertical blanking interval decoder means and generat- 
ing a command to transfer said text/graphic signal from 
said non-volatile storage means to said monitor means 
to display said text/graphic signal or said monitor 
means. 

14. The system as recited in claim 13, wherein said 
non-volatile storage means is an optical disk drive. 

15. The system as recited in claim 13, wherein the data 
signal includes a memory address. 

16. The system as recited in claim 13, wherein said 
processor means commands a storage of said text/graphic 
into a file of said non-volatile storage means. 

17. A system, comprising: 

broadcaster means for transmitting a video signal and a 
data signal that is inserted into a vertical blanking 
interval of the video signal; 

video receiver means for receiving the video and data 
signals; 

vertical blanking interval decoder means for separating 

the data signal from the video signal; 
video decoder means for converting the video signal into 

a television signal; 
monitor means for displaying the television signal; 
non-volatile storage means for storing a text/graphic 

signal that is resident on said non-volatile storage 

means; and, 

processor means for receiving the data signal from said 
vertical blanking interval decoder means and generat- 
ing a command to transfer said text/graphic signal from 
said non-volatile storage means to said monitor means 
to display said text/graphic signal on said monitor 
means. 

IS. The system as recited in claim 17, wherein said 
non-volatile storage means is an optical disk drive. 

19. The system as recited in claim 17, wherein the data 
signal includes a memory address. 

20. The system as recited in claim 17. wherein the 
processor means commands a storage of said text/graphic 
into a file of said non-volatile storage means. 
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